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Abstract 

We introduce an infinite particle system dynamics, which includes 
stochastic chemical kinetics models, the classical Kac model and free 
space movement. We study energy redistribution between two en- 
ergy types (kinetic and chemical) in different time scales, similar to 
energy redistribution in the living cell. One example is considered 
in great detail, where the model provides main formulas of chemical 
thermodynamics . 
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1 Introduction 



As it is well-known, thermodynamical functions and some formulas of the 
classical thermodynamics can be deduced from Gibbs canonical or grand 
canonical ensemble. However, all thermodynamics, even the heat exchange, 
has deeply dynamical nature and demands extra dynamics (this is even 
more true for the chemical thermodynamics). This extra dynamics can 
be modelled in various ways, satisfying however strong restrictins. For 
example, in some scaling limit for small time scales it should give ther- 
modynamic formulas. In this paper we give examples of such "thermo" 
dynamics, which, from one side, generalize the classical Kac ^ISj model 
(for convergence to Boltzman equation) and stochastic chemical kinetics 
processes (see fl3', H^). From another side, it adds energy parameter to 
Streater's statistical dynamics ^18j and Othmer's complex reaction net- 
works theory ]T6\ [T7]. 

We try to concert this dynamics with the chemical thermodynamics 
and with energy redistribution between "heat" energy and chemical energy. 
We model this with two time scales. The first time scale corresponds to 
the "fast" dynamics, which governs the equilibrium behaviour, conserves 
the number of molecules of each type and brings the system quickly to 
equilibrium. In fact we assume that infinitely quickly. Second time scale 
corresponds to the "slow" dynamics, that does not conserve the number 
of particles, governs non-equilibrium process travelling along the mani- 
fold of equilibrium distributions. We model this dynamics with mean field 
dynamics of the stochastic chemical kinetics (taking into account energy 
redistribution) . 

We describe here the simplest possible case, which demonstrates con- 
ceptual picture without entering complicated mathematical techniques. Al- 
though the calculations in this paper do not meet any technical difficulties, 
it was not easy for me to reconstruct mathematically the conceptual pic- 
ture corresponding to what is written in chemical textbooks. Obviously this 
model allows generalizations in many directions, including very technical. 
We discuss some of them in the last section. 

The generalization of the Kac model goes roughly as follows. First, Kac 
type models (where a molecule possesses only kinetic energy, or velocity) 
are married with stochastic chemical kinetics, where normally the molecules 
differ only by type. As a result the molecule becomes characterized by a pair 
(j, T), that is by the type j and kinetic energy T. Then one more energy 
parameter is added to this pair - the chemical energy K. However, still 
there are no volume, pressure and other thermodynamic functions. Instead 
of introducing them apriori, "by hands", we throw particles independently 
into A and define the simplest possible but natural dynamics: velocities are 
defined by kinetic energies, and the particles move with constant velocities 
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in-between the jumps. 

The plan of the paper is the following. In the next section we define 
the model and show the existence of the limiting infinite particle dynam- 
ics, consisting of the free movement in space and some non-linear Markov 
process, corresponding to reactions. This dynamics, after some scaling 
limit, leaves invariant some manifold SJIq in the space of probability mea- 
sures. This manifold is defined by finite number of parameters and consists 
of Gibbs equilibrium distributions for the mixture of ideal gases. We give 
selfcontained exposition of formulas for thermodynamic functions in section 
3. In section 4 we introduce "thermo" dynamics (macroscopic evolution of 
thermodynamic parameters) and show that it is a deterministic dynamical 
system on SJIq- In section 5 we consider unimolecular reactions and chemi- 
cal thermodynamics laws for this case. Last section is devoted to discussion 
of further problems. 

I thank Christian Maes for kind attention, fruitful remarks and stimu- 
lating discussions. 

2 Microdynamics 

Molecules We consider molecules as classical point particles with trans- 
lational and internal (for example, rotational and/or vibrational) degrees of 
freedom. More exactly, first of all, any molecule is characterized by its type 
j. Translational degrees of freedom are given by its velocity v G R^, coor- 

dinate x G and the kinetic energy Tj = — ^ — (with mass rrij). Internal 
degrees of freedom are assumed to be of two kinds - fast and slow. They 
are also given by some energy functionals Ij {yj ) , Kj [zj ),yj € Ij , Zj G Kj 
in the space Ij x Kj of internal degrees of freedom. It is often assumed, 
see [4], that the total energy of the molecule is 

^Tj{v,) + Ij{y,) + Kj{zj) 

Thus, we assume that the degrees of freedom of the molecule can be "fast" 
or "slow". The corresponding parts of the energy will also be called either 
"fast" or "slow": T is always fast, and say I is fast, and K is slow. One 
of our goals is to introduce some models of energy redistribution between 
fast and slow parts. 

For notation purpose only, we mostly take Ij = 0, unless otherwise 
stated, and we assume further on that Kj = Kj{zj) is constant, depending 
only on j. Kj can be thought roughly as the energy of some chemical bonds 
in the j type molecule. 

Reactions There are corresponding fast and slow reactions. Fast reac- 
tions do not touch slow parts, but slow reactions may change both slow 
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and fast energies, thus providing energy redistribution between heat and 
chemical energy. We consider here the following reactions: 

1. slow unary (unimolecular) reactions A ^ B; 

2. slow binary reactions of any type A + B ^ C + D; 

3. fast binary reactions of the type A + B A + B, which draw the 
system towards equilibrium; 

4. fast process of heat exchange with the (environment, with reactions 
of the type A + B ^ A + B, but where one of the molecules is an 
outside molecule. 

In any considered reaction the total energy conservation is assumed, that 
is the sum of total energies in the left side is equal to the sum of total 
energies in the right side of the reaction equation. 
Now we proceed to rigorous definitions. 

2.1 Finite volume dynamics 

System in a finite volume A is defined as follows. Finite number A'' of 
particles (molecules) i = 1,...,N, each equipped with degrees of freedom 
j, T, K, are thrown uniformly and independently in the cube A. The dy- 
namics consists of two processes: basic Markov jump process M]^(t), de- 
scribing the evolution of internal degrees of freedom, and free space move- 
ment which will be defined for each trajectory of M^it). The process 
M^it) has states {(ji,Ti),i = 1,...,A''} and will be defined on the state 
space I = ({!,..., J} x The particles in the process Mffit) are or- 

dered, because in the space dynamics they will have coordinates. 

Unary (unimolecular) reactions Assume that J{J — 1) nonnegative 
functions (rates) 

of T € R+ be given. Dependence on T is very important to be compatible 
with energy redistribution: for example, the reaction may not be possible 
for low reactant kinetic energies. The rates do not depend on i and are 
assumed bounded functions of T. Unimolecular reactions A ^ B have been 
used to describe many biological processes, for example, protein and RNA 
conformational transitions, transcription and translation processes etc. 

Consider finite continuous time homogeneous Markov chain with state 
space I, which is defined as follows: any particle i having at time t type j = 
j{t) and kinetic energy T = T{t) waits, independently of the other particles, 
some random time r. This random time is assumed to have exponential 
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distribution with the rate Uj{T) = Y]j^ Ujj^{T). Then at time t + r the 
particle chooses with probabihty pjj-^ = y ^"^. the type ji to perform 
the jump j — )■ ji. However the jump does occur iff T + Kj — Kj^ > 0. If 
T + Kj — Kj^ < then nothing occurs and the process starts anew. 
One could equivalently say it Uke this. Define the allowed set 

A{j,T) = {j,:T + Kj-Kj,>0} 

of types for the particle of type j and having kinetic energy T. Then such 
particle waits exponential time with the rate 

and then changes its type to ji with probability 

The transformation j — > ji of the particle i at time t + T is accompanied 
by the energy redistribution (T, Kj) — > (Ti ~ T + Kj — Kj^ , Kj^). In other 
words, we assume energy conservation Ti + Kj^ = T + Kj. 

We also assume that the velocity v immediately after the jump j — > ji 
becomes uniformly distributed on the sphere of radius Ti. Note that one 
could assume much less. 

We could define the state space of the process MN{i) as the sequence 
of arrays Xi = {ji,Vi \ ,i = 1, TV. Then rij is the number of i such that 
ji = j , N = ni + ... + nj. However, due to our agreement about velocities 
we can take instead the state of a molecule as Xi = {ji,Ti}. Denote -ff^^ 
the generator of the A^-particle process, defined on some appropriate func- 
tion space on ({1, .... ,/} x R^)^ , which we will not write down explicitely, 
because it is quite standard. 

For example, for one particle we have continuous time Markov process 
Mi{t) with the state space (j.T): the T{t) component is uniquely defined 
by initial conditions and by the sequence of type transformations. 

Slow binary reactions Here the Markov jump process is the following. 
On the time interval {t, t + dt) each (ordered) pair (i, i') of molecules, with 
parameters {j,T),{j',T') correspondingly, has a "collision" with proba- 
bility jj'bjjidtjbjji = bjji{T,T') = bj'j. Then at the moment of collision 
the parameters of the particles at time t + become correspondingly 
(ii)^i)) Oi)^i)- The distribution of the new parameters is defined by the 
conditional densities 

P^'\juT,,j[\{j,T),{j',T')) 
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that are defined for any j, f ,T,T', ji , Ti , j[ , then Ti T + K + T' + K' - 
Ki — Ti — K[. To justify this definition it is assumed that 

P^''Hji,T,,j[\{j,T),{j\T'))^0 
ii T + K + T' + K' - Ki - Ti - K[ < 0, and 

P^''Hji,T,,j[\{j,T),{j',T'))>0 
ii T + K + T + K' - Ki - Ti - K[ > 0. Moreover, for any (j, T), (j', T') 

^ I dTipWo-i,ri,j-i|(j,r),(/,T')) = i 

We assume the same agreement about new velocities, that is each of 
them is distributed independently and uniformy on the corresponding en- 
ergy sphere. 

Denote H^^^ the corresponding generator, on the same function space. 

Fast binary reactions Their definition is similar to slow binary reaction 
process, but the particles do not change types and slow energies, so only 
redistribution of their kinetic energies occurs, that is T, T' — Ti,T[. The 
agreement concerning velocities holds as above. We write the collision 
probabilities as fjj'dt^ fjj' = fj'j, we assume also that in the reaction 
the energy conservation T + T' — Ti + T[ holds. We assume 
that fjji do not depend on T and T' . As for the conditional distribution 
we will use the one defined below, similar to the example 

inH. 

We define Kac type models as follows. Assume that there is a family 
M(a),0 < a < oo, of distributions fia on with the following property. 
Take two i.i.d. random variables ^1,^2 with the distribution M{a). Then 
their sum ^ — £,1 + ^2 has distribution M{2a). We assume also that a is 
the expectation of the distribution M{a). Denote p(Ci|0 the conditional 
density of ^1 given ^, defined on the interval [0,^]. We put 

pif) T') = p{Ti\T + T') 
and of course T{ = T + T' — Ti . Denote the corresponding generator H)^ . 

Heat transfer We model it similarly to the fast binary reactions, as 
random "collisions" with outside molecules in an infinite bath, which is kept 
at constant temperature /3. The energy of each outside molecule is assumed 
to have distribution with 3 degrees of freedom and with parameter /3. 
More exactly, for each molecule i there is Poisson process with some rate h. 
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Denote Uk, k — 1,2, its jump moments, when it undergoes collisions with 
outside molecules. At this moments the kinetic energy T of the molecule i 
is transformed as follows. The new kinetic energy Ti after transformation 
is chosen correspondingly to conditional density p on the interval [0, T + 
£,ik], where are i.i.d. random variables having distribution with 
density cx^ exp{—/3x). Denote the corresponding conditional density by 
p(fi){Ti\T). In fact, this process amounts to N independent one-particle 
processes, denote the corresponding generator H^K 



Pull dynamics Note that both for unary and slow binary reactions the 
numbers nj of type j molecules are not conserved but the total number of 
molecules N = J^j is conserved. On the contrary, fast reactions conserve 
rij. The process Mwit) is defined by the sum of generators 

Hisf, sp) = + H^^^ + + s^ijff ' 

on some appropriate function space on ({!,..., J} x -R+)^, where s/,s^ 
are some large scaling factors, which eventually will tend to infinity. This 
process belongs to a class of well studied classical processes. 

The state space of the full process is the sequence of arrays Xi = 
{ji,Xi,Vi} ,i = 1,...,N, then rij is the number of i such that ji — j 
molecules, N — rii + ... +nj. However, due to our agreement about veloc- 
ities, we can take instead the state of a molecule as Xi = {ji, Xi, Ti}. 

For each trajectory uj of Mjv(i) we define the local space dynamics as 
follows. It is quite simple: it does not change types, energies, velocities, 
but only coordinates. If at jump moment t the particle acquires velocity 
v{uj) = v(t + 0,Lo) and has coordinate x{t,uj), then at time t + s 

x{t + s,Lu) = x{t,Lu) + v{uj)s (1) 

unless the next event (jump), concerning this particle, of the trajectory 
UJ occurs on the time interval [t,t + s]. We assume periodic boundary 
conditions, or, that is the same, elastic reflection from the boundary. 

We denote the resulting process XA.N{t). It depends of course also on 
the initial conditions and on s/, s^. 

Remark 1 One of the disadvantages of the dynamics defined above is that 
there is no momentum conservation. This could be justified by including 
a fast process (similar to the defined above) of elastic collisions with some 
other smaller particles, which quickly establishes uniform distriution of ve- 
locitie^. Moreover, instead of the motion with constant velocity in-between 

^The author thanks one of the referees for this remark. 
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collisions in such models it could be even more natural to consider isotropic 
diffusion w(t) with zero drift and put 



x{t + s, u) ~ x{t, Lu) + w{s) 



instead of ([!]]. Instead of the velocity v for one-particle motion one would 
have the covariance of the diffusion. One should only fix somehow the 
dependence Tia"^). Most considerations below admit this generalization. 
Thius generalization could allow to take into account deeper results con- 
cerning reaction- diffusion equations, see JPj [3 \2(A \21}/ . 

2.2 Infinite particle dynamics 

We show that the infinite particle hmit exists. However, we do not get in 
general a Markov process, but only so called nonlinear Markov process. 

Unimolecular reactions Denote T), j — 1, J, the densities (with 
respect to the Lebesgue measure dT) of the one-particle process Mi at time 
t 



If there are only slow unary reactions, then due to the energy conservation, 
for Ml there exist (under mild conditions on Ujj-^) the limiting densities 
Tr(j, T) — limt_i.ooPt(i, T), depending on the initial conditions, because this 
chain is strongly reducible. 

Define infinite particle dynamics Xp^ (t) as the collection of independent 
one-particle trajectories, where po is the initial distribution for each parti- 
cle. For infinite particle case one particle trajectories are defined exactly as 
in a finite volume, only there are no boundary conditions, and the particle 
moves in the whole space. 

Define the limiting concentrations Cj{t) = limA-s-ocA^^ < n.j{t >~ 
Pt{j)c, where pt{j) is the probability that at time t a molecule has type j. 

Heat transfer Heat transfer is also a one-particle process and in the 
infinite particle evolution is defined similarly to the previous one. It will 
also be Markov. 

Binary reactions The case with binary reactions is more involved be- 
cause one cannot define mean field dynamics directly for infinite particle 
system. Nevertheless, we define the so called nonlinear Markov process. 
It consists of deterministic evolution of the densities pt{j,T), defined by 
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some Boltzman type equation, and infinite number of independent inho- 
mogeneous Markov jump processes for internal degrees of freedom of the 
individual particles. These two evolutions are concerted with each other 
in the sense we explain below. In this sense mean field dynamics in the 
infinite limit becomes local. In other words, if we are observing some local 
region, we never see simultaneous jumps of two particles, but only jumps 
of one particle - the particle with which it "collides" is a.s. infinitely far 
from this region. 

The exact definition proceeds quite similarly to the finite particle dy- 
namics with one essential difference. The infinite particle dynamics consists 
of the process Moo{t) and free space movement. The jump process Maoit) 
is defined as collection of independent one-particle processes Moo,i. Each of 
this one-particle processes is defined by the following Kolmogorov equations 

gpt(ji,Ti) _ 
dt 

= Y.j {P{t\ji,Ti\3,T)pt{j,T) - P(t;j,T|ji,Ti)pt(ji,Ti))dr (2) 

3 

defining Markov process with distributions pt{j,T). To complete the def- 
inition one should define the transition kernel. When all four types of 
reactions are present, the kernel is 

4 

m— 1 

that is the sum of four terms m — 1,2,3,4, corresponding to the four 
reaction types, introduced above, 

= u,,, {T)6{T + K-Ki- Ti), 



P^^^ = Y.JdT'dT[2b,,,P^'\n,T,,j[\{j,T),ij',T')) 

ptif, T')5{T + K + T' + K' - /vi -Ti-K[- T[), 

^''^ =%iE / PiPiTi\T,T')2f,rPt{f,T')dr, 
j' 

Pf-*) = h6jj,P'^^\Ti\T) 

We see that terms 2 and 3 depend on pt{j,T). One should find then 
Pt{j,T) from equation, obtained by substituting ((3)) into ([l]!}). We get the 
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Boltzman type equation.. In our case it is not difficult to prove existence 
and uniqueness of pt {j, T) , because it is obtained as the limit of mean field 
processes. Also the chaos property similar to one in the Kac model follows. 
The chaos property corresponds to the independence of each particle jumps. 
Note however that the processes Moo i are time inhomogeneous. 

Consider now infinite particle system in R^, where each particle has 
internal parameters (j, v). Denote 9Jl the system of all probability measures 
for this system with the following properties: 

• coordinates of these particles are distributed as the homogeneous 
Poisson point field of particles on with some density c, 

• each particle has a vector of parameters j, T distributed (indepen- 
dently of its coordinate and of the other particles) via some common 
distribution p{j,T), the same for all particles. 

Consider a sequence of processes XA.N{t) with N = A^(A), A — > oo so that 
^^^^-^ — > c > 0. Then at time the distribution of XA,Ar(0) converges to 
some distribution belonging to the set 9Jt. 

Theorem 2 // the initial distribution belongs to 9H then the infinite-particle 
dynamics exists, moreover 9Jt is invariant with respect to this infinite parti- 
cle dynamics. Under the conditions stated above, the thermodynamic limit 
Xc{t) of the processes X\_N{t) exists and belongs to 2H at each time moment 
t. 

Proof. To prove existence of the thermodynamic limit we proceed in 
two steps. On the first step we do not care about coordinates. If there are 
only unary reactions, there are no problem - one should not perform the 
thermodynamic limit. But for binary reactions one should. 

Note that we can reformulate binary collisions in a finite volume as 
follows. As an example we take fast binary collisions where we can say 
that any particle i of type j undergoes "collision with SOME molecule of 
SOME type j'" with the probability 



After the infinite volume limit the probability of collision becomes 



The same can be done for the energy distribution, that is we get (0). 
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(4) 
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To prove the existence of infinite particle dynamics one should prove 
first the existence of solutions of the Boltzman equation, and then the 
existence of the Markov process for the individual particle. All these tech- 
nicalities are put in the Appendix. 

Remark 3 Note that in one could interpret Cj' {t) as some local con- 
centration of particles in the vicinity of the j particle. This gives some 
links to local dynamics. This hints on some possible generalizations of the 
process which could include spatial correlations. 

On the next step, we need to prove that the homogeneous Poisson 
distribution in space is invariant. 

We use the following general lemma. Note that the assumption that 
the velocities are uniformly distributed on the energy sphere is not essen- 
tial. It is sufficient only that the velocity process did not depend on the 
coordinates. 

Lemma 4 Let all particles in the configuration {xi{t)} in R'^ move (inde- 
pendently) as 

Xi{t) = Xi{0) j Vi{s,u))ds 

where the velocities Vi(t,uj) are independent processes with arbitrary time 
dependence. Then the Poisson distribution is invariant. 

Proof. Take TV such particles in the finite cube A with the same in- 
dependent movement, only take periodic boundary conditions. The result 
will follow if we prove that the uniform distribution on A^ is conserved 
with such dynamics. In fact, one can perform afterwards the thermody- 
namic limit with ^ — c. Then the uniform distribution at any time t 
converges to the Poisson distribution, the finite volume dynamics at time t 
converges to the dynamics in because for fixed t and sufficiently large A 
the particle does not reach the boundary of A. Thus Poisson distribution 
is invariant. See also general results of this kind in pj. 

Because of the independence it is sufficient to consider iV = 1 that is one 
particle, thrown at time with uniform distribution into A. Assume that 
the particle moves in this cube with some speed v{t) - arbitrary random 
function of time. The only condition is that v{t) does not depend on the 
coordinate of the particle. Then it is clear that the uniform distribution is 
invariant. 
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3 Thermodynamic functions for mixture of ideal 
gases 

In our case the Gibbs state will be the system of independent particles 
(ideal gas). Here we give a selfcontained presentation (fixing the notation 
we use here) of main formulas for the classical ideal gases and mixtures, 
with one important difference: the fast degrees of freedom are gaussian and 
slow degrees of freedom are constants Kj^ depending only on j. 

A well-known example of internal energy functional is the quadratic 
Hamiltonian 

dj —3 9 



k=l 

where rrij^kjk = l,...,dj — 3, are some coefficients and the vector yj — 
{wj^k, k — 1, ...,dj — 3} G W^'^^. Then dj — 3 is the number of internal 
degrees of freedom of the molecule of type j, dj is the number of all degrees 
of freedom. This is justified, for example, when internal oscillations are 
small, see We will call this the Gaussian case. We will need another 
extreme case, when Kj are constants. 

Thus each molecule of type j has the energy 

We consider a finite number nj of particles of types j = 1, J in a 
finite volume A. For the ideal gas of the j type particles the grand partition 
function of the Gibbs distribution is 

= X] ^ ( 11 / / / dxj^.dvj^^dyjA X 

"3 2 

X exp^(/Xjnj - ^(— Liii + Ij{yj,i)) - K^) = 

i=l 



where 



^ — A"^73--"^B"^ exp/?(/Xj - Kj)n, = exp(A/3, = Bjexp/3jAj) 



n,=0 "' 



dj—3 

„ , ZTT . 3 -I— r , Stt . 1 

Bj = — ^ n "'Aj = - 

rrio -1- J- T71 , 



General mixture distribution of J types is defined by the following partition 
function 
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Define the grand thermodynamic potential 

O = = -^"^ In e = -p-^K ^ \j exp pjlj 

j 

The limiting space distribution of type j particles is the Poisson distribution 
with rate (concentration) Cj, and 

<nj>A i91ne ^ a- (a a aj^ \ 

Cj = = /3 = Xj exp = exp(/3/ij - /3/ij,o - pKj) 

Put c = ci + ... + cj. Then 

fij = InC^^ATi) = Mi,o + P-' Inc,- + i^,-, (5) 

where 

M,-,o = In A,- = ln/3 + InS, ) (6) 

is the so called standard chemical potential, it corresponds to the unit 
concentration cj = 1. 

The internal energy in thermodynamics is defined as the mean of the 
sum of energies of all particles. The conditional mean energy (given type 
j) particle is (the law of equipartition of energy) 

and 

j 

The pressure is defined as 

^ = = ^ < >= ^ = 

j j j 

where pj = l3~^Cj are the partial pressures. In the thermodynamic limit 
this is equivalent to the definition 

BP= lim ^Ine 

y->-oo A 

The well-known equation of state follows 

PA = /3-^^<n,> (7) 
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For one type j the entropy is defined as 

S3 = = exp(/?A,)(^ + l-/3Aj) =< > i^ + l+pKJ-|3^l,) 

(Sackur- Tetrode formula). For the mixture it is the sum of these S = 

Together with the internal energy U three other important thermody- 
namic potentials are: the enthalpy 

i7 = C/ + PA = /3-i^<n, >(^ + l + /3iC,), (8) 

j 

Gibbs free energy 

G = H- p-^s ^Y,^^J < >' 

3 

and Helmholtz free energy 

F = U-I3-^S 

We can define also the densities of the extensive (that is asymptotically 
linear in A) thermodynamic variables in the thermodynamic limit. For 
example we define the limiting Gibbs free energy for unit volume as 

g= lim ^ ='S^ UiCj 

4 "Thermo" dynamics 

For given rate parameters w, b, f, h the internal degrees of freedom of the 
particles are independent and identically distributed random variables. In 
other words, the distribution belongs to COT. However, the kinetic energies 
may have not distributions, that is the velocities may not have Maxwell 
distribution. We will force the kinetic energies to become using the limit 
Sf — >■ 00. 

Denote Gibbs state of the j-type ideal gas as Qj — Qj{/3,fij). Define 
TIq C 9Jt the set of all measures x jQj{/3, ^j) for any /3, //i, /^j, and 
9Jto,^ - its subset with fixed /3. In physical and biological books on non- 
equilibrium thermodynamics, there are some general statements, see for 
example [1^1, which hold for many concrete examples, in particular they 
will hold in our model. Firstly, there is a submanifold in the space of 
probability measures on the state space, defined by a finite number of 
macroparameters, and moreover, this submanifold is invariant with respect 
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to the full dynamics. Secondly, each point of this manifold is a product 
of k independent measures. In our case each point v £ DJIq is a product 
v ^ h'l X ... X i/j and the points of DJIq are in one-to-one with the vector 
Ai = {f3, /ii, fij) of parameters. Note that a point of DJIq is also uniquely 
defined by the vector ci, cj). The third general statement concerns 
different time scales, that we discussed above. 

The following result, in despite of its evidence, is crucial for discussing 
chemical thermodynamics. 

Theorem 5 The limits in distribution 

€c{t)= lim Xc{t),Dc.t3it) = lim €c{t) 

exist for any fixed t. Moreover, the manifold DJIq is invariant with respect 
to the process €c{t) for any fixed rates u,h,h. The manifolds SDto,^! o.fs- 
invariant with respect to Dc,p{t). 

Thus, in the process €c{t) the velocities have Maxwell distribution at 
any time moment. For the process Dcpit) moreover, at any time t the 
temperature is equal to /3, that is there is heat exchange with the environ- 
ment. 

The resulting process £c(0 can be defined, using the evolution 

of Cj{t) and formula ([S]), also by the deterministic evolution of the vector 
M{t) = 

5 Thermodynamics of unimolecular reactions 

Let us make first some remarks about conserved quantities. Note that 
= < rij > (for finite A) and J2j (for inifinite volume) are con- 
served. Then from the equation of state ([7]) it follows that the pressure P 
is conserved (for fixed /3), the same for the grand potential. Thus in our 
model A'', P, A are conserved. 

Further on we consider only the process Oc,0{t)- Then all thermody- 
namic potentials are functions (for fixed Ki, ...,Kj) on 9Jlo;3, for example 
the enthalpy H , or the Gibbs free energy G. 

Hess's law Consider two different processes /ij"'^' (i) and /ij^' (t),j = 1,..., J, 
on $Ho,,3! for example with different reaction rates. Assume also that for 
some T > 

t,f\0) = (0),Mf ^(T) = A^f = 1, J 

that is these two processes have the same initial and final points. Then the 
Hess law says that the differences between initial and final enthalpies are 
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the same for both processes. In fact, this law holds automatically in our 
model, because both processes are described by two paths on 9Jto,^ with 
the same initial and final points, and the enthalpy is a function on the 
invariant manifold 9Jto.0- 

The simplest classification of reactions is in terms of the enthalpy H . If 
IS.H — H{oo) — H{0) < then the reaction is called exothermic, the heat 
Q is goes to the environment, if AH > the reaction is endothermic and 
the heat is taken from the environment. That is AH = Q. 



Equilibrium conditions We assume further on that there are no slow 
binary reactions, moreover we consider the case J — 2. That is, consider 
the system with two types and two reversible reactions 1^2. Thus we 
have 2 parameters ^i,/i2 and fixed (3. 

Let us remind how the equilibrium condition /ii = /i2 appears in chem- 
ical thermodynamics. For the extensive variable X =< ni > the corre- 
sponding conjugate variable A (thermodynamic force) is (assuming N =< 
ni > + < n2 > fixed) called (chemical) affinity 

^ = -|§I/3.P.A' = -M1+M2 = -AGo-r^ In — , AGo = Mi,o-M2,o-(^i^i+^s^2) 

UA C2 

AGo is called the free energy of the reaction. Note that instead of vectors 
{fii, ...,^j) for the points of 97to,/3 one can use points (ci, ...,cj). Then A 
can also be defined as 

A = ~%(3,P,c 

OCi 

The equation of state (relation between X and A) is 

c 



Cl 



1 + cxp(-/3^ - AGo) 



Equilibrium points are defined as points where A = 0, this gives fii = fi2- 
From ^ it follows that the equilibrium condition /xi = /i2 in chemical ther- 



£l,, 
c 

Cj^e- The equilibrium constant is defined as 



modynamics uniquely defines the quotient of the equilibrium densities 



K^^^ exp(-/3AGo) (9) 

C2,e 

Moreover, for a given c the equilibrium condition uniquely defines a (fixed) 
point on 2to.^, that is the invariant Gibbs measure. 



Stochastic chemical kinetics reconstructed Now we give an example 
of such process in our case. Assume Ki < K2. Assume now the simplest 
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possible dependence of ujjf on T: Ujj'{T) equal some constants Wjj' if 
Tj + Kj — Kji > 0, and Ujji{T) — otherwise. Then the process Dc,/3(i) 
can be given explicitely. Denote gp{r) = P{\£,\ > r) for the random 
variable ^ with inverse temperature (3. 

It is easy to see that the process Dc.p{t) can be reduced to the Markov 
chain on {1,2} with rates 

V21 = W21, Ul2 = gp{K2 - Ki)wi2 

Monotonicity of Gibbs energy for fixed /3 This law says that Gibbs 
free energy G has its minimum at the fixed point and G{t) is monotonic 
in time. It is evident in the vicinity of the equilibrium point. One can say 
more, if the process Cj{t) corresponds to some Markov process. 

Let any Markov process with two states 1, 2 be given such that for some 
constant C 

pi{t) = Cci{t),p2{t) = Cc2{t),ni = Ccue,n2 = Cc2^e (10) 

where Pj{t) are its probabilities at time and tTj are its stationary proba- 
bilities. 

Remind that for a finite irreducible Markov chain with the rates Wjj' the 
entropy of the positive measure p — (pi, ..-tPj) relative to the stationary 
measure tt = (tti, ttj) is defined as 

SM=J2p,lnP^^Cj2c,ln^ (11) 

Now we will prove that the Gibbs free energy g and Markov entropy 
Sm are equal up to a multiplicative and additive constants. 

Theorem 6 At any time t we have for the Gibbs free energy density g[t) 

g{t) = tic+-^SM{t) 

where fj, — fii — fj,2. It follows that g{t) is time monotone. 

Moreover, the process Pj(t) , satisfying UU\) . is unique, up to a common 
time scale. 

Proof. For the Gibbs free energy density we get using ^ 

Q ^ ^ ^ 

5 = lim ^ = XI ^i^^i ^'^Yl "^J "^J + Yl (^J'O + ^j)= (12) 

3 3 3 

= [3^^ X Cj In Cj + X Cj — In Cj^e) — MC + /^^"^ ^ Cj In -^^ 
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At the same time 



As S]\j is known to decrease during Markov evolution, see [3], the second 
assertion of the theorem foUows as welL 

Let us show now that there is unique choice of dynamics, that is of the 
rates Vjji , which give equihbrium condition /ii = /i2. Each Markov chain 
with two state is reversible, because reversibility condition 7riwi2 = 712^21 
follows immediately from Kolmogorov equation 

—— = 7^2^;2l - 7riUi2 
at 

Then 

^ = ^ (13) 

7r2 C2,e 

In fact from 

1^2 V12 

and (|13p it follows that Vjji are uniquely defined up to some constant C, 
which determines some common time scale (speed of both reactions) and 
is irrelevant to thermodynamics. Theorem is proved. 

Relation with Onsager theory in our example is the following. The flux 
is defined as 

Jl =Xi 

or in the thermodynamic limit 

_ dci 

And from the equations 
dci 

— = C2U21 - C1U12, C2 = c - Ci 
at 

we have 

1 - exp{-pA) 



+ u^i cxp(-/3A) 



Energy redistribution Assume that at time t = an arbitrary distri- 
bution po{j, T) of the vector (j, T) is given. Then at any t > the densities 
Pt{j,T) for any particle will be 

cVTeM-PT)Pt{j) (14) 
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for some Pt{j)- This can be shown as follows. As the internal degrees of 
freedom of infinite number of particles are i.i.d. random variables, then 
there exist a.s. the limits 

T(t) = lim 1 Tdt),K{t) = ]im j ^ K.^t) 

A->-oo A ^ — ' A-s-oo A -"^ — ' 

exist at any time t. In particular, a.s. for any fixed values of Kj.{t) the 
limits 

T(t)- lim 1 J2 T,{t.K{t)) 

A^oo A ^ — ' 
i:XieA 

exist and are equal. Here K{t) = {Kj.{t), i — 1,2, ...}. 

Moreover for any given K{t) there is a sequence of jump moments 

h <t2 < ... < tn < ... 

of fast binary collisions and heat transfer, which do not change parameters 
ji (and thus Kj.) of the molecules. If and s^.tend to infinity we have a.s. 
there will be "infinite" number of fast collisions and heat transfers between 
any two unary reactions. It follows that any time t we have a product 
measure ([T4|) . 

We will study the sequence K{t). As any time moment t > we have 
T{t) — (3^^ put also T'(O) — /3^^ for continuity. Now there two possibilities: 

1. K{0) < K(oo), this means that the kinetic energy, pumped up to the 
system with the heat, is transformed to the chemical energy; 

2. K{0) > K(oo), this means that the chemical energy is transformed 
to the kinetic energy, which goes out as the heat. 

6 Further Problems 

This paper is a kind of advertisement for mixed dynamics. Pure local dy- 
namics, even in one dimension, leads immediately to too difficult problems. 
Mixed dynamics is simpler and many situations could be modelled with it, 
especially in biology. It is quite natural to discuss here possible related 
problems, there are many. 

Logical structure From one side, chemical thermodynamics has some 
distinct logical structure, from the other side this structure is based on 
some approximations. Our model suggests a distinct implementation of 
this logical picture, and shows what is the nature of the approximations. 
Moreover, there are fundamental questions. We go now to more detailed 
discussion: 
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Chemical thermodynamics largely uses ideal gas formulas, for exam- 
ple see formula ([5]). For this reason the corresponding expressions 
can be only approximate; 

Equilibrium conditions play the central role in the chemical kinetics. 
In fact, they are based on the assumption that the chemical equi- 
librium corresponds to the minimum of the Gibbs free energy, in a 
sufficiently large class of measures, see the end of this section. It is 
not at all clear for me whether this should be considered as a funda- 
mental experimental fact or it should be deduced from microscopic 
dynamics. A possible key could be the coincidence of some thermo- 
dynamic potential with Lyapounov function for the dynamics, see the 
above example. See also [S1|B]; 

The dynamics for a system with chemical reactions is ambiguous it- 
self. The reactions can be incorporated into hamiltonian dynamics 
only via some probabilistic mechanism. It is what we do here, us- 
ing another field of physical chemistry - stochastic chemical kinetics. 
This dynamics cannot be arbitrary - the constraints on it are posed 
by the equilibrium conditions, given apriori. 

There is also a deeper reason for the dynamics ambiguity. If we do 
not want to use random mechanisms for reaction, we are encoun- 
tered with the dual nature of bound states. From one side, bound 
states are considered (in chemical thermodynamics) as fundamental 
particles at EACH (except discrete time moments when reactions oc- 
cur) time moment. From the other side, it appears as a composite 
particle (in the classical physics) from hamiltonian dynamics via scat- 
tering theory. In the latter for the bound state formation one needs 
INFINITE or at least finite time interval. Thus, it is ambiguous to 
prescribe when the new composite particle appears. 

The same problems arise for quantum hamiltonians with chemical re- 
actions, in terms of annihilation-creation operators, with non-quadratic 
terms corresponding to collisions. 

Possibly there is some escape from all these problems even in the gen- 
eral local models, that is for nonideal gases with interaction between 
different gases. There should be equivalent representation of this 
complex system by ideal gases of quasiparticles. The corresponding 
quasiparticles could even correspond to real particles surrounded with 
clouds, that is the particles become slightly renormalized. However, 
quasiparticle representation can be obtained now rigorously only for 
some ground state models, and only for equilibrium dynamics, see 
This approach brings us to another tabula rasa: consider an 
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infinite particle system where elementary particles are atoms, not 
molecules. Then we are in the framework of purely Hamiltonian 
system. One should be able to show that the dynamics brings this 
measure to the configurations where most atoms form bound states 
- molecules. 

Non ideal systems The deterministic part of the theory of chemical 
networks is presented in [16], in completely rigorous beautiful framework. 
However, there was no energy component, no probability and no micro- 
scopic dynamics. 

The logical framework of [TC] is the following: deterministic chemical 
kinetics is postulated together with some restrictions on the invariant man- 
ifolds, related to the (also postulated) Gibbs free energy G. It is presented 
as 

dG 

— = ^ Mj,o(/3, P) + ln7j(c)cj 

where Jjicj) are some unknown functions of Cj. If 7j(cj) = c^^ for all j, 
then the system is called ideal. As for the nonideal systems, microscopic 
models should give information about jj. 

However, even for nonideal system the same question as above will be 
the main enigma of the chemical thermodynamics. 

More thermodynamical processes We did not consider chemical ther- 
modynamics for binary reactions in this paper. However, it is clear that 
it can be done, because (as it is shown in section 2) its inifinite particle 
dynamics is quite similar to unimolecular dynamics. Also reactions which 
do not conserve N are of interest. In particular, decay and synthesis that 
is A — >■ B + G and A + B ^ C. Here for the first reaction one should assign 
somehow the coordinate to B and G. It can be done in the following way: 
one molecule, for example B, with probability i will have the coordinate 
of A, then G is put randomly into A. It seems unnatural in a finite volume, 
but in the infinite volume, it will give, as for slow binary reaction, a local 
process for particles. Together with evolution of densities. 

We are lacking microscopic models even for simpler situations in non- 
equilibrium thermodynamics: local models quickly become too difficult to 
be useful. However mixture of local models with mean field dynamics 
looks quite promising, and tractable. For example, one could consider 
exchange of matter with the environment, work and efficiency produced by 
mechanochemical and chemochemical machines, etc., see |10| . 

In quantum case there can be other statistics, Fermi and Bose, reac- 
tions with them are interesting to consider. Also one could try to model 
reactions in solutions or reactions with large P, nuclear reactions etc. Some 
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substitutes for Clausius entropy are used in nuclear physics, for which there 
are no dynamical models. 

Biology In biology it is known heuristically that the chemical networks 
may have different time scales. First scale is the fundamental microscale, 
it is the fastest scale, where local equilibrium establishes for some thermo- 
dynamic parameters (for our model it was the global equilibrium) . Second 
scale (call it micro non-equilibrium), is the scale of main concrete reactions. 

If the chemical network is large enough there can be also other scales, 
even slower than the second one. For example, genetic networks can be 
modelled as if the list of reactions changes with time, slower than the scale 
of the reactions. 

It seems very important to understand and classify these scales and 
model all main time scales. One cannot yet even pose exact mathematically 
reasonable questions here. 

Variational Problems Assume that some system has states 1, 2, ... with 
energy levels Sh of the state k. Gibbs distribution on the set {1,2,...} is 
defined as 

Pk = exp(-^efc), = X] exp(-/3£fc) 

fe 

Then it is known and easy to show that Gibbs equilibrium state is the state 
of maximum entropy S for fixed mean energy U . To see this we are looking 

for extrema of 

S = - ^Y^Vk Inpfe + A^EfePfe 

k k 

with two constraints 

= ^ EfePfe = C, ^Pfe = 1 

fe fe 
Thus we are looking for extrema of 

-^^Vk^'t^Vk + y^'^ZkVk^-l^^Vk 
fe fe fc 

Differentiation gives 

- Inpfe + 1 + Asfe -h 7 = 

That is 

Pk =C exp Xsk 
where A < for convergence reason. 
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Similarly, equilibrium state is the state of minimum mean energy U for 
fixed entropy S. Here we differentiate 

SkPk - A^Pfelnpfe +7^pfc 

k k k k 

Grand canonical ensemble is included to the previous scheme. In fact, 
consider grand canonical ensemble 

DO OO 

X! exp ^((/iiV - ^ EATfe) 
N=a k=l 

where £]v/c are the energies levels of the system with N particles. This case 
can be reduced to the previous one if is considered among the energy 
levels, that is introduce Sno — -~IJ-N. 

The Helmholtz free energy A = U — j3~^S is defined for any measure, 
that is for any system {pk-,Ek}- In our case P and A are constant, as 

P = l3-^c 

Thus the Gibbs free energy G = A-\- PA is also defined for some class of 
measures, including our manifold 9Jto- It could be interesting to know the 
widest class of measures, where G is defined and is a Lyapounov function 
for an appropriate "thermo" dynamics. 

Appendix 

Here we present some technicalities omitted in the main part of the paper. 
We use here natural and intuitive, but "not quite standard", approach to 
the convergence proof of mean field type Markov processes with large num- 
ber of particles. It does not use standard techniques of martingale problem, 
semigroup generators, tightness of measures, etc. This approach, coming 
from cluster expansion ideas, is based on small piece of combinatorics and 
simple probabilistic estimates. To avoid cumbersome notation, we present 
this method for binary reactions only, that is general enough to see all pe- 
culiarities. Moreover, it is clear that this approach can be applied to many 
other situations as well. This techniques proves both smooth dependence of 
the limiting distributions on t and on initial data, and the chaos property. 

The model Consider continuous time Markov process ^^(t) = {S.^ (t), v = 
l,...,iV),t e [0,00) with state space S*^, where S is some space of one- 
particle states. To define the process we fix some linear operator U : 
M{S'^) M{S'^), where M(S'^) is the set of measures on S"^ with variation 
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norm. This operator is defined by the conditional measures dcr^si, s'i\s, s'), 
where da is the family, indexed by the pairs (s, s'), of probability measures 
on the set of pairs (si, Sj). For any pairs v, v' of different particles the op- 
erators U{v, v') define transformations on the set M(S^) of measures on 
the state space . This operator acts as U only on v and v' components 
of 5^, it is assumed symmetric with respect to permutation v v' . 

The transitions of the process are defined in two steps. Firstly, each par- 
ticle V = 1,...,N generates independent Poisson process of time moments 
with rate A. Denote = Ny{u>) the random number of time moments on 
the time interval [0,t\, generated by the particle v and let 

< < ... < t„,jv„(a;)(w) < t 

be the these moments. We have 

P(iV„(w) =n) 

and the density of the vector {ti < 

p{ti < ... < tn)dti...dt„ = 

= exp{—Xti)Xdti...exp{—X{tn — tn-i))Xdtnexp{—X{t — t„)) = 

= exp{-Xt)X^dti...dtn 

In other words, it is uniform on the simplex {0 < ti < ... < tn < t}. At 
each time moment t^s a pair {v,Wi) is produced, where Wi ^ v is chosen 
with probabiity . One could say equivalently that each pair generates 
independent Poisson process with rate j^zi- Merging them together, we 
get the combined Poisson process, which we denote 

< < t2(w) < ... < in(w) < t 

It has rate (density) NX. 

For a given uj denote w), w) the pair produced at time U in the 
combined process. In fact, we can take uj as the sequence 

{ti,Vi,v[),i= 1,2,... (15) 

itself. 

We will consider (ordered) sequences of (unordered) pairs 

9 = {vi,Wi),...,{Vn,W„) (16) 

We call 1^1 = n the length of 6. Thus for any w the sequence 

e = e{uj) = {{vuv';),i = i,2,...) 



(At)" , . ^ 
= ^-^expi-Xt) 

... < tn) is given by 
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is defined. 

For any sequence 9 we define the chronological product of measure trans- 
formations 



acting from left to right. Thus, for any lj the quantities 9{Lu),n — n{uj) 
and U{u!) = U{0{uj)) are uniquely defined. The measure on 5^ at time t 
is given by 



where d uj is the measure on Poisson trajectories for given N . 

Assume, for any N, that at time i = the one-particle distributions 
^^(0) of Sy are i.i.d. Then we have the following result. 

Theorem For any v — 1,2,... one-particle measures (t), converge as 
N oo uniformly in fiv{0) on any finite interval (0,to), to some 
l^v{t): identical for any v. Moreover, fc-particle distributions f.{t) 
converge to the product x ... x ^i{t). 

The plan of the proof will be the following. For tq sufficiently small we 
will obtain explicit absolutely convergent series for any finite-dimensional 
distribution. This gives complete control for small times. To prove the 
same properties for larger t one can use the semigroup property (as one 
can write t = kr^ -\- t' for some k and t' < tq) and uniformness on the 
initial one-particle distribution. 

Clusters We need some combinatorics. We call abstract sequence 
of pairs connected if Vk C\{vk,Wk} ^ for any k = l,...,ri— 1, where 



The pair {vi,Wi} in 6 is called essential if {vi,Wi} does not belong to Vi. 
Connected sequence is called essential if all its pairs are essential. It follows 
that there are no identical pairs in the essential connected sequence. We 
call w-sequence any connected sequence with w € w„}. 

For any v and any uj we define a subsequence 9y{uj) of 9{ijj) as fol- 
lows. Take maximal j such that v S {vj^Wj}. If there is no such j 
then put 9v{uj) = 0. If there is such j — then we define 9v{to) 

as the minimal subsequence of 9{uj) satisfying the following two condi- 
tions: 1) if u G {vi,Wi} then {vi,Wi} € Oy{uj); 2) if for i < j the pair 
{vi,Wi} belongs to 9y{uj), then any pair {vk,Wk} for k < i and such that 
{vi, Wi} n {wfc, Wk} 7^ 0, also belongs to 9y{uj). 



U{9)^U{v,„Wn)...U{vi,wi) 




n 




i=k+l 
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Resummation formula For given v and any connected w-sequence 9 we 
consider the probabilities 

p^W = p{e,{uj) = e),p^ = J2 P^'i^) 

\e\=k 

and will use the following resummation formula 

e 

where Bi is the projection on the distribution of particle 1, x^JLj^ /i„(0) is 
the initial distribution on 5*'^' and lk{0) is the number of elements in the 
union Ur=n-fe+i{^i'^i}- 

It is easy to get explicit formula for . For example, for n = that 
is for the empty we get P^ = exp(— 2At), for n = 1 we have 

P^ = exp(-2A(i - t{)) exp(-2A(2 - 

that is there is no particle 1 on the time interval {ti,t) and there are no 
particles 1 and i (assuming that 6 = (1, i)) on the interval (0, ti). For n = 2 
we have 

p^ = Y,p{e,{u) = {i,i),{i,j)) + ^p{9^{uj) = (i,i),(i,i))+ 
+ 5^p(^iM = (i,i),(i,i)) 

where for example, 

EP(ei(a;) = (l,i),(l,j)) = 

N — 2 f f 1 
= (2Af^^ J y exp(-2A(t-i2))exp(-2A(2-^^)(t2-ii))x 

2A 

X exp(- ^_ ^ a3ti)dtidt2 

where 03 is the number of pairs, which intersect with {1,2,3}. In the 
general case the formula looks quite similar 

2A f f ^ 2A 

^'^(^) = (iv^)" / ■•■ / \[^M-HN,k,e)^^(tk-tu-i))du...dtn 

fe=i 
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where m{N, k, 9) are some positive numbers. However, we will simplify our 
task: we do not need exact expression for the exponents because we will 
use the estimates 

exp(-mA(tfe - ife^i)) < 1, \\U{x)\\ < 1 
For the integration we will use 

dti...dtn = -r (17) 

m 

It is convenient to consider equivalence classes of connected sequences. We 
say that two sequences are equivalent if one can be obtained from the 
other by some permutation (f> : {1,...,A^} — >■ {1,...,A^} of particles. Note 
that ■m{N, k, 9) and P^{9) depend only on the equivalence class. 

Let A be a subset of {1, ...,n}. We say that a sequence 9 has type A 
if the pair {vi^Wi} is essential for any i e {l,...,n} \ A and nonessential 
otherwise. Essential sequences correspond to A = 0. The number C^'^L 
of essential sequences of length n satisfies the following properties 

ij^.rcZl - n ^ (j^ir^'Zl ^ nl (18) 

k=l 

For any nonempty A we get similarly 

i^rcH^I < n\, (^)"Cfj ^ (19) 

as — > cx). 

We need also the evident property that m{N,k,9)^^^ tend to some 
■m{k, 0) as iV — >■ oo. Finally we have 

A.f(t) = Bi^(^)" J2 I - hM-'2^Mk,9){tk-tk-i)) 
n e:\e\=n 

xd<i...dt„^;7(0)(Mi(O) X ... X Ai;„(e)(0)) 

ess 

By (fTg)l , in the limit non essential sequences do not count and we get using 

m 



fiiit) = ^ A" ^ / ... / exp(-2Am(fc, 9){tk 
xdti...dtn^U{x)iniiO) X ... X Mn+l(0)) 



tk-l)) 
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For small t the terms of both series have uniform exponentiall bounds by 
(|17[) . Moreover, due a term- by-term convergence, 

tends to zero in the norm. C°° dependence on t follows from this. Chaos 
property can be shown quite similarly. 
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